Bayes Empirical Bayes: Finite Parameter Case

Empirical Bayes Estimation in Nonstationary Markov chains

Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical  Bayes estimators  for the transition probability  matrix of a finite nonstationary  Markov chain. The data are assumed to be of  a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...

Empirical Bayes vs. Fully Bayes Variable Selection

For the problem of variable selection for the normal linear model, fixed penalty selection criteria such as AIC, Cp, BIC and RIC correspond to the posterior modes of a hierarchical Bayes model for various fixed hyperparameter settings. Adaptive selection criteria obtained by empirical Bayes estimation of the hyperparameters have been shown by George and Foster [2000. Calibration and Empirical B...

An Improved Bayes Empirical Bayes Estimator

Consider an experiment yielding an observable random quantity X whose distribution Fθ depends on a parameter θ with θ being distributed according to some distribution G0. We study the Bayesian estimation problem of θ under squared error loss function based on X, as well as some additional data available from other similar experiments according to an empirical Bayes structure. In a recent paper,...

Bayes and empirical Bayes changepoint problems

We generalize the approach of Liu and Lawrence (1999) for multiple changepoint problems where the number of changepoints is unknown. The approach is based on dynamic programming recursion for efficient calculation of the marginal probability of the data with the hidden parameters integrated out. For the estimation of the hyperparameters, we propose to use Monte Carlo EM when training data are a...

Bayes and empirical Bayes : Do they merge?